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Abstract — Streaming erasure codes encode a source stream to 
guarantee that each source packet is recovered within a fixed 
delay at the receiver over a burst-erasure channel. This paper 
introduces diversity embedded streaming erasure codes (DE-SCo), 
that provide a flexible tradeoff between the channel quality and 
receiver delay. When the channel conditions are good, the source 
stream is recovered with a low delay, whereas when the channel 
conditions are poor the source stream is still recovered, albeit with 
a larger delay. Information theoretic analysis of the underlying 
burst-erasure broadcast channel reveals that DE-SCo achieve the 
minimum possible delay for the weaker user, without sacrificing 
the performance of the stronger user. A larger class of multicast 
streaming erasure codes (MU-SCo) that achieve optimal tradeoff 
between rate, delay and erasure-burst length is also constructed. 

I. Introduction 

Forward error correction codes designed for streaming 
sources require that (a) the channel input stream be produced 
sequentially from the source stream (b) the decoder sequen- 
tially reconsructs the source stream as it observes the channel 
output. In contrast, traditional error correction codes such as 
maximum distance separable (MDS) codes map blocks of data 
to a codeword and the decoder waits until the entire codeword 
is received before the source data can be reproduced. Rateless 
codes such as the digital fountain codes also do not form ideal 
streaming codes. First they require that the entire source data 
be available before the output stream is reproduced. Secondly 
they provide no guarantees on the sequential reconstruction 
of the source stream. Non-block codes such as convolutional 
codes in conjunction with sequential decoding can be designed 
for low delay applications [4|. However to our best knowledge, 
these constructions need to be optimized through a numerical 
search for finite constraint lengths. Low-delay codes with 
feedback are recently studied in J5), ||6) while compression 
of streaming sources is studied in Q- 

In 0] Chapter 8] a new class of codes, streaming erasure 
codes (SCo) are proposed. The encoder observes a semi- 
infinite source stream — one packet is revealed in each time 
slot — and maps it to a coded output stream of rate R. The 
channel is modelled as a burst-erasure channel. Starting at 
an arbitrary time, it introduces an erasure-burst of maximum 
length B. The decoder is required to reconstruct each source 
packet with a maximum delay T, A fundamental relationship 
between R, B and T is established and SCo codes are 



constructed that achieve this tradeoff. We emphasize that the 
parity check symbols in these constructions involve a careful 
combination of source symbols. In particular, random linear 
combinations, popularly used in e.g., network coding, do not 
attain the optimal performance. 

The SCo framework however requires that the value of B 
and T be known apriori. In practice this forces a conservative 
design i.e., we design the code for the worst case B thereby 
incurring a higher overhead (or a larger delay) even when the 
channel is relatively good. Moreover there is often a flexibility 
in the allowable delay. Techniques such as adaptive media 
playback [ 8 1 have been designed to tune the play-out rate as a 
function of the received buffer size to deal with a temporary 
increase in delay. Hence it is not desirable to have to fix T 
during the design stage either. 

The streaming codes introduced in this work do not commit 
apriori to a specific delay. Instead they realize a delay that 
depends on the channel conditions. At an information theoretic 
level, our setup extends the point-to-point link in |Q] to 
a multicast model — there is one source stream and two 
receivers. The channel for each receiver introduces an erasure- 
burst of length Bi and each receiver can tolerate a delay 
of Ti. We investigate multicast streaming erasure code (MU- 
SCo) constructions that achieve the maximum rate under these 
constraints. We primarily focus on a particular subclass — 
diversity embedded streaming erasure codes (DE-SCo). These 
codes modify a single user SCo such that the resulting code 
can support a second user, whose channel introduces a larger 
erasure-burst, without sacrificing the performance of the first 
user. Our construction embeds new parity checks in an SCo 
code in a manner such that (a) no interference is caused to 
the stronger (and low delay) user and (b) the weaker user 
can use some of the parity checks of the stronger user as 
side information to recover part of the source symbols. DE- 
SCo constructions outperform baseline schemes that simply 
concatenate the single user SCo for the two users. An infor- 
mation theoretic converse establishes that DE-SCo achieves 
the minimum possible delay for the weaker receiver without 
sacrificing the performance of the stronger user. Finally all 
our code constructions can be encoded and decoded with a 
polynomial time complexity in T and B. 



(»[']},» 



(*Wko 



*[*]=/,(*[0] s[']) 



[ill ^^^- Burst 



8[f] 



Fig. 1: The source stream {s[i]} is causally mapped into an output 
stream {x[i]}. Both the receivers observe these packets via their 
channels. The channel introduces an erasure-burst of length Bi, and 
each receiver tolerates a delay of Ti, for i = 1,2. 

II, System Model 

The transmitter encodes a stream of source packets 
{s[i]}t>o intended to be received at two receivers as shown in 
Fig. fl] The channel packets {x[i]}t>o are produced causally 
from the source stream, x[t] — /t(s[0], . . . , s[i\). 

The channel of receiver i introduces an erasure-burst of 
length Bi i.e., the channel output at receiver i at time t is 
given by 

* te \ji,ji + Bi - 1] 

x[t] otherwise 



Vi[t] 



(1) 



for i = 1,2 and for some ji > 0. Furthermore, user i 
tolerates a delay of Tj, i.e., there exists a sequence of decoding 
functions 7it(.) and j 2 t(-) such that 



Si[t] = jit(vi[0],yi[i\, ■■ .,yi[i + Ti] 



1,2, (2) 



and Pi(si[t] ^ Si[i\) = 0, Vi > 0, . 

The source stream is an i.i.d. process; each source symbol 
is sampled from a distribution p s (-). The rate of the multicast 
code is defined as ratio of the (marginal) entropy of the source 
symbol to the (marginal) entropy of each channel symbol i.e., 
R = H(s)/H(x). An optimal multicast streaming erasure 
code (MU-SCo) achieves the maximum rate for a given choice 
of (Bi,Ti). Of particular interest is the following subclass. 

Definition 1 (Diversity Embedded Streaming Erasure Codes 
(DE-SCo)). Consider the multicast model in Fig. UYwhere the 
channels of the two receivers introduce an erasure burst of 
lengths B\ and Bi respectively with B\ < B 2 . A DE-SCo 



is a rate R 



Ti 



Ti+Bj 



MU-SCo construction that achieves a 



delay T\ at receiver 1 and supports receiver 2 with delay T 2 . 
An optimal DE-SCo minimizes the delay T 2 at receiver 2 for 
given values of B\, T\ and B 2 . 

Our setup generalizes the point-to-point case in [ 1 , Chapter 
8] where single user SCo codes for parameters (B\,T\) 
achieve the streaming capacity T T X B . An optimal MU-SCo 
construction, attains the maximum rate for fixed parameters 
(Bi,Ti). An optimal DE-SCo fixes the rate to the capacity of 
user 1, and supports user 2 with the minimum possible delay 
T 2 . 

Note that our model only considers a single erasure burst 
on each channel. As is the case with (single user) SCo, 
our constructions correct multiple erasure-bursts separated 
sufficiently apart. Also we only consider the erasure channel 
model. It naturally arises when these codes are implemented in 
application layer multimedia encoding. More general channel 



models can be transformed into an erasure model by applying 
an appropriate inner code [1 Chapter 7]. 

III. Example 

We first highlight our results via a numerical example: 
(B 1 ,T 1 ) = (1,2) and (B 2 ,T 2 ) = (2,4). Single user SCo 
constructions from fT), Q for both users are illustrated in Ta- 
ble [ft a) and W[b) respectively. In each case, the source symbol 
s[i] is split into two sub-symbols (so[i],Si[«]) and the channel 
symbol x[i] is obtained by concatenating the source symbol s[i] 
with a parity check symbol p[i]. In the (1, 2) SCo construction, 
parity check symbol pa [i] = s% [i — 1] © so [i — 2] is generated 
by combining the source sub-symbols diagonally across the 
source stream as illustrated with the rectangular boxes. For 
the (B, T) = (2, 4), the choice p B [i] = Si [i - 2] © s [i - 4] is 
similar, except that an interleaving of step of size 2 is applied 
before the parity checks are produced. 

How can we construct a single code that simultaneously 
supports both {(1, 2), (2, 4)}? The first approach is to concate- 
nate the two parity check streams as shown in Table, lite). Each 
receiver ignores the parity check rows of the other receiver and 
performs single user decoding. However such a concatenated 
streaming code (Cc-SCo) achieves a rate of 1/2, whereas the 
optimal MU-SCo construction achieves a rate of 3/5. Before 
specifying the optimal MU-SCo code construction, let us first 
consider designing a DE-SCo (see Def.[T} for this setup. Recall 
that this code, of rate 2/3, satisfies (Bi,T\) — (1,2), also 
achieves minimum delay T 2 for B 2 = 2. 

In Tablefilja) we illustrate a rate R = 2/3 code that achieves 
T 2 = 6. It is obtained by shifting the parity checks of the SCo 
code in Table W[b) to the right by two symbols and combining 
with the parity checks of the SCo code in Table |I|a) i.e., 
q[i] = pa[i\ © PB[i — 2]. Note that parity check symbols 
Pb[] do not interfere with the parity checks of user 1 i.e., 
when s[i] is erased, receiver 1 can recover p^[i + 1] and 
Pa[i + 2] from q[i + 1] and q[i + 2] respectively by cancelling 
Pb[] that combine with these symbols. It then recovers s[i}. 
Likewise if s[i] and s[i— 1] are erased, then receiver 2 recovers 
Pb [i + 1], • • • , Pb [i + 4] from q[i + 3], . . . , q[i + 6] respectively 
by cancelling out the interfering Pa[']> mus yielding T 2 = 6. 

The interference avoidance strategy illustrated above is sub- 
optimal. Table. Intb) shows the DE-SCo construction that 
achieves the minimum possible delay of T 2 — 5. In this 
construction we first construct the parity checks ps[i] = 
si[i — 2](&so[i — 1] by combining the source symbols along the 
opposite diagonal of the (1,2) SCo code in Table [11 a). Note 
that x(i) = (s[i],pB[i\) is also a single user (1,2) SCo code. 
We then shift the parity check stream to the right by T+B = 3 
symbols and combine with pa[i\ i-e-, q[i] — Pa[i\ ©Pb[* — 3]. 
In the resulting code, receiver 1 is still able to cancel the effect 
of Pb[] as before and achieve T\ = 2. Furthermore at receiver 
2 if s[i] and s[i — 1] are erased, then observe that receiver 2 
obtains so[i] and s a [i — 1] from g[i+2] and q[i+3] respectively 
and si [i — 1] and si [i] from q[i + 4] and q[i + 5] respectively, 
thus yielding T 2 — 5 symbols. 



(a) SCo Construction for (B, T) = (1, 2) 
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(b) SCo Construction for (B,T) = (2,4) 
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TABLE I: Single user SCo constructions are shown in the upper two figures. The Cc-SCo construction in the last figure repeats the parity 
checks of the two single user codes to simultaneously satisfy both the users. This baseline approach is in general sub-optimal 
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(b) DE-SCo Code Construction for (Bi.Ti) = (1,2) and (B 2 ,T 2 ) = (2,5) 
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TABLE II: Rate 2/3 code constructions that satisfy user 1 with (B\,Ti) — (1,2) and user 2 with B 2 — 2. 



Finally, the R = 3/5, MU-SCo {(1,2), (2,4)} construction 
is as follows. Split each source symbol s[i] into six sub- 
symbols So [i] , • • ■ , 85 [i] and construct an expanded source 
sequence §[■] such that s[2i] — (so[i], 8i[i], ss[i]) and s[2i + 
1] = (s 3 [i],s 4 [i],s 5 [i]).Thereexistsa{(2,3),(4,8)}DE-SCo 
code (see Thm. [Ill that we apply to $[•] to produce the parity 
checks p[-] and transmit p[i] = (p[2i],p[2«+l]) along with s[i] 
at time i. Due to the properties of the DE-SCo construction 
and our source expansion, the resulting code corrects a single 
erasure with a delay of 2 symbols and an erasure-burst of 
length 2 with a delay of 4. An explicit construction is provided 
in the full paper [9| due to space constraints. 

IV. Construction of DE-SCo 

In this section we describe the DE-SCo construction. We 
rely on several properties of the single user SCo; see |fl] 
Chapter 7-8], Q for the background; [9] for a detailed proof. 



Theorem 1. Let (B\,T\) = (B,T) and suppose B 2 = aB 
where a is any integer that exceeds 1, The minimum possible 
delay for any code of rate R 



T+B 



T* = aT 



B, 



(3) 



and is achieved by the optimal DE-SCo construction. 



The converse in Theorem [T] states that the rate of any 
{(B,T),(B 2 ,T 2 )} MU-SCo with T 2 < T* is strictly below 
R. We establish this by constructing a periodic burst-erasure 
channel in which every period of (a — 1)B + T% symbols 
consists of a sequence of aB erasures followed by a sequence 
of non-erased symbols. Following a similar line of reasoning 
as in [3] Theorem 2] we can show that a MU-SCo code 
corrects all erasures on this channel. The rate of the MU-SCo 



code then must not exceed 1 
R if T 2 < T 2 *. 



aB 

(a-l)B+T 2 



which is less than 



For achievability, T 2 in ([3]) we construct the following code: 
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Fig. 2: Decoding for DE-SCo {(4, 7), (8, 18)}. 



Let C\ be the single user (B, T) SCo obtained by 
splitting each source symbol s[i] into T sub-symbols 
(si[i\, . . . ,st[i\) and producing B parity check sub- 
symbols p A = (p A [i], . . . ,pg [i] ) at each time by com- 
bining the source sub-symbols along the main diagonal 2) Recover the parity checks p 



Step 3 The decoder then retrieves symbols s u [t] = 
(st-b+i[t], ■ ■ ■ ,st{t]) for i — aB < r < i at 
time t = t + T£ using the parity check symbols p B [t] 
and the previously decoded non-urgent symbols. The 
sub-symbols s u [-] are the urgent sub-symbols of Ci (2). 
Steps 1 and 3 above follow from the single user SCo construc- 
tion of Ci and C-2 respectively. Step 2 is established 1 9] via a re- 
cursive decoder stated in LemmafT] In the following we define 
d A = ( Sl [i\, . . . , ST [i+T-l}), df=( Sl \t], . . . , a T [»-(T-l)4) 
as the sub-symbols involved in Q and |5]) respectively. 

Lemma 1. The decoder for user 2 recovers the non-urgent 
symbols s N [-] in the following order 

1) Recover the non-urgent symbols in d B _ aB , . . . , d B _ B _-, 
using the parity check symbols {p B [t 



,p A [i + T-l]fr, 



i.e., 



P A V] = A k ( Sl [i-T-(k-l)},. . . , s T [i-l-(k-l)}) (4) 

Let C 2 be a ((a - 1)B U (a - l)Ti) SCo also obtained 
by splitting the source symbols into T sub-symbols 
($i [i] , . . . , st [i] ) and then constructing a total of B parity 



checks p = (pf 



,Pb[*\ 



by combining the source 



sub-symbols along the opposite diagonal and with an 
interleaving step of size £ = (a — 1) i.e., 

p B [*] = B k {si{i-i-{k-l)t},. . .,s T [i-£T-(k-l)i\). 

(5) 

• Introduce a shift A = T + B in the stream pb['} and 

combine with the parity check stream p A [] i.e., q[i] = 

p A [i] ® p B [i — A]. The output symbol at time i is x[i] = 

(s[i\,q\i}) 

Since there are B parity check sub-symbols for every T 

source sub-symbols it follows that the rate of the code is T J g . 

Decoding at User 1; Suppose that the symbols at time 

i — -B, . . . , i — 1 are erased by the channel of user 1. User 

1 first recovers parity checks p A [i] , . . . , p A [i + T — 1] from 

q[i], . . . ,q[i + T— 1] by cancelling the parity checks p B [] that 

combine with p^[-] in this period. Indeed at time i + T — 1 the 



interfering parity check is p [i + T — A — 1] 



v B V- 



B-l], 



which clearly depends on the (non-erased) source symbols 

before time i — B. All parity checks p s [-] before this time 

are also non-interfering. The erased source symbols can be 

recovered from p A [i], . . . , p A [i + T — 1] by virtue of code C\. 

Decoding at User 2: Suppose that the symbols at times 

i — 1, . . . , i — aB are erased for receiver 2. The decoding 

proceeds as follows: 

Step 1 At times t > i + T, the decoder recovers parity check 

p B [t] from q[t] by cancelling the parity checks p A [t] 

which depend only on (non-erased) source symbols at 

time i or later. 

Step 2 At times i < t < i+T the decoder uses q[i] and at times 

i + T < t < T = i - aB + T 2 *, the decoder uses p B [t] 

(obtained in Step 1), to recover symbols {s^t]}^"! 1 ^^ 

where s n [t] = (si[r], . . . , st-b[t]) denotes the set of 

non-urgent sub-symbols for C^ [2|. 



q|tJ,...,qi* + T-l]. 
3) Recover the non-urgent symbols in d A _ 



ing the parity checks p J 



,p>- 



•T-l], 

4) For each k € {1, . . . ,T — B — 1} recursively recover 

the remaining non-urgent symbols as follows: 

(Ind. 1) Recover the non-urgent sub-symbols in 

d A _ Bk using the non-urgent sub-symbols in 

{df}.,<i+0-i)(a-i)-,B-i and parity checks p A [] 

between i < t < i + T. 

(Ind. 2) Recover the non-urgent sub-symbols in 

•> d f-B+k( a -l)-l usin S 

Br 



\ B 



{d A }j>i_B—(k—l) an d th e parity checks p B [ 
between i + T < t < T. 

Once this recursion terminates, all the non-urgent sub- 
symbols {s JV [r]}^L i _ aB are recovered by time T — 1. 

Fig. [2] illustrates the DE-SCo {(4, 7), (8, 18)} construction. 
Each column represents one time-index between [—8, 17] 
shown in the top row of the table. We assume that a burst- 
erasure occurs between time [—8,-1] and only show the 
relevant symbols and parity-checks. Each source symbol is 
split into seven sub-symbols, each occupying one row. Each 
source sub-symbol has two labels - one number and one letter. 
The letter represents the main diagonal that passes through 
the sub-symbol e.g., sub-symbols in d A x are marked a. The 
number represents the off-diagonal that passes through the sub- 
symbols e.g., sub-symbols in d B 1 are marked 8. The next four 
rows denote the parity check sub-symbols. The parity checks 
for C\, generated by diagonal d A , (c.f. Q) are marked by 
the same letter. The four top rows, in lighter font, show the 
parity checks generated by the diagonal d B for C<z, shifted by 
T + B = 11 slots. These parity checks are combined with 
the corresponding parity checks of C\ as shown in Fig. [2] For 
example the cell marked (cl) at time t = 4 indicates that this 
sub-symbol of q[4] results by adding the parity check of C\, 
marked c, with the parity check of C2, marked 1, at t = 4. 

We illustrate the decoding steps in Lemma [T] By construc- 
tion of C\ all the parity checks p A [t] after time t > 7 do 
not involve the erased symbols. In particular the parity checks 
marked by a, b and c at t > 7 can be canceled to recover 



parity checks marked by 1, 2, 3 and more generally all p B [t] 
for t > 7. Note that this allows us to recover the non-urgent 
(i.e., the top three rows) erased sub-symbols in d^g, . . . , d B _ 5 
by t = 9. Next, compute parity checks marked by 1, 2, 3 of 
C2 in the shaded area in Fig. [2] and cancel them and recover 
the parity checks marked by a, b and c. At this point we 
have all the parity checks p A [] for < t < 6. Since the 
diagonals d^ l7 . . . , d^ 4 involve four or fewer erasures we can 
now recover these sub-symbols. 

The remaining non-urgent sub-symbols need to be recovered 
in a recursive manner. Note that d^ 5 , marked by e, has five 
erased symbols. However the first symbol marked by (4e) also 
belongs to d B _ 5 and has already been recovered. The remaining 
four sub-symbols can be recovered by the four available parity 
checks of Pa[] marked by e. Similarly d^ 4 , marked by 5, 
also has five erasures, but the first symbol (5rf) also belongs 
to df 4 and has been recovered. Hence the remaining parity 
checks can be recovered using the parity checks of p [•]. Of 
these, by construction of C2, the non-urgent symbols will be 
recovered by time T = 9. The decoder then recovers d^ 6 and 
d^ 3 in the next step to recover all non-urgent sub-symbols. 

V. Optimal MU-SCo constructions 

The DE-SCo construction in the previous section simulta- 
neously satisfies two receivers with parameters [B\,T\) and 
B2 = aB\, and TJ = aT\ + B\ for any integer a > 1 
with a rate R = T qfg . From the single user capacity bound, 
clearly this is the maximum possible rate for any MU-SCo 
code. Furthermore DE — SCo is also optimal for any other 
receiver with T2 > T£ . Below we state the regimes in which 
the optimal MU-SCo constructions are known [9|. 

Theorem 2. Suppose that the burst-delay parameters for user 
1 and 2 are (B\,T\) and (-62,12) respectively. Suppose that 
B2 = o.B\ for some integer a > 1. Then optimal MU-SCo 
constructions are known for the following values of T%: 

A 



c= { 



T1+S1 ' 
T2-B1 

T2-B1 + B2 ' 


r 2 >T 2 * = aT 1 + B l! 

max{£ 2 , T 1 } + B 1 <T 2 < T 2 *, 
T x <T 2 <T l +B 1 ,B 2 <T X 
T 2 <Tx 


Ti+Ba' 

T 2 
T2+B2' 



(6) 



The different regions in |6j are also summarized in Fig. [3] 
For clarity we ignore the integer proportionality constraints on 
the parameters in this figure (extension for non-integer values 
is included in [9|). The first case in |6j) corresponds to regions 
marked (a) and (b). In region (a), the capacity can be achieved 
by a simpler interference avoidance construction (illustrated in 
Table. [Hja)) rather than the DES-Co construction. Region (c) 
corresponds to case 2 in |6j). The capacity is achieved through a 
DES-Co construction for a modified value of T\. The example 
of {(1, 2) - (2, 4)} in Section [m] falls in this region. The full 
derivation is provided in [9]. Region (f) corresponds to case 3 
in ((6). The capacity is achieved by a (B2,Ti) SCo code and 
finally for region (g), which corresponds to the last case in ((51, 
the capacity is achieved by a (-62,^2) SCo code. In regions 
(d) and (e) the capacity remains open except for a special case 




(B,.B,) 



Fig. 3: Achievable Capacity Regions. Suppose B\ and T\ are 
constants, so the regions depend on the relation between T? and B?. 



when T 2 = B 2 and 7\ = B\ where the concatenation based 
scheme is known to be optimal Q. 

VI. Conclusion 

This paper constructs a new class of streaming erasure codes 
that do not commit apriori to a given delay, but rather achieve a 
delay based on the channel conditions. We model this setup as 
a multicast problem to two receivers whose channels introduce 
different erasure-burst lengths and require different delays. 
The DE-SCo construction embeds new parity checks into the 
single-user code, in a such a way that the weaker receiver 
can also recover the stream with an information theoretically 
optimum delay. MU-SCo constructions that are optimal for a 
range of burst-delay parameters are also provided. 

At a broader level, our paper sheds insight into the interest- 
ing impact delay can have in multiuser channels. How can one 
order two receivers — one with a weaker channel but a relaxed 
delay constraint and one with a stronger channel but a stringent 
delay requirement? The present paper illustrates the intricate 
interaction between delay and channel quality. We hope that 
this paper sparks further interest into this fascinating area. 
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